Method for operating mirrored content under mirror mode and computer readable storage medium

ABSTRACT

The embodiments of the disclosure provide a method for operating a mirrored content under a mirror mode and a computer readable storage medium. The method includes: enabling a touch capturing function on the smart device, wherein the touch capturing function intercepts a touch event inputted to the smart device; in response to determining that a raw touch event is intercepted by the smart device, translating the raw touch event to a first touch event and sending the first touch event to a host, wherein a display screen of the smart device is mirrored to a visual content shown by the host, and the first touch event triggers the host to report a second touch event happened in the visual content; disabling the touch capturing function and receiving the second touch event from the host; and performing a first operation in response to the second touch event and enabling the touch capturing function on the smart device.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the priority benefit of U.S. ProvisionalApplication Serial No. 63/289,153, filed on Dec. 14, 2021. The entiretyof the above-mentioned patent application is hereby incorporated byreference herein and made a part of this specification.

BACKGROUND 1. Field of the Invention

The present disclosure generally relates to a method for interactingwith visual contents, in particular, to a method for operating amirrored content under a mirror mode and a computer readable storagemedium.

2. Description of Related Art

See FIG. 1 , which shows a schematic diagram of a mirror mode. In FIG. 1, when the smart device 110 (which may be a smart device) and the host120 (which may be a head-mounted display (HMD)) are operating under themirror mode, the display screen 112 of the smart device 110 can bemirrored to the visual content 121 provided/shown by the host 120.

The host 120 can be used to provide various reality services, such asvirtual reality (VR), augmented reality (AR) or the like, and the visualcontent 121 may include a specific region 122 for showing a contentmirrored from the display screen 111. In this case, the variationhappens on the display screen 111 would be mapped to the content shownin the specific region 122.

Conventionally, the user of the host 120 can use a handheld controller130 to interact with the smart device 110 via interacting with thespecific region 122. For example, the visual content 121 may include acontroller representative object 131 corresponding to the handheldcontroller 130, and the user may use the controller representativeobject 131 to interact with specific region 121 by, for example,triggering a region 123 (which corresponds to an application 112) shownin the specific region 121 with a raycast 131 a.

For example, the user may press a specific button (e.g., a confirmingbutton) on the controller 130 while using the raycast 131 a to point tothe region 123 corresponding to the application 112. In this case, theapplication 112 would be accordingly activated on the smart device 110.

However, in the scenario shown in FIG. 1 , the user needs to use thehandheld controller 130 to interact with the host 120, which isinconvenient to the user.

SUMMARY OF THE INVENTION

Accordingly, the disclosure is directed to a method for operating amirrored content under a mirror mode and a computer readable storagemedium, which may be used to solve the above technical problems.

The embodiments of the disclosure provide a method for operating amirrored content under a mirror mode, including: enabling, by a smartdevice, a touch capturing function on the smart device, wherein thetouch capturing function intercepts a touch event inputted to the smartdevice; in response to determining that a raw touch event is interceptedby the smart device, translating, by the smart device, the raw touchevent to a first touch event and sending, by the smart device, the firsttouch event to a host, wherein a display screen of the smart device ismirrored to a visual content shown by the host, and the first touchevent triggers the host to report a second touch event happened in thevisual content; disabling, by the smart device, the touch capturingfunction and receiving, by the smart device, the second touch event fromthe host; and performing, by the smart device, a first operation inresponse to the second touch event and enabling, by the smart device,the touch capturing function on the smart device.

The embodiments of the disclosure provide a method for operating amirrored content under a mirror mode, including: showing, by a host, avisual content, wherein a specific region of the visual content ismirrored from a display screen on a smart device, and the visual contentcomprises a controller representative object corresponding to the smartdevice; in response to receiving a first touch event from the smartdevice, obtaining, by the host, a specific position indicated by thecontroller representative object; in response to determining that thespecific position is within the specific region, accordingly generating,by the host, a second touch event; sending, by the host, the secondtouch event to the smart device, wherein the second touch event triggersthe smart device to perform a first operation in response to the secondtouch event.

The embodiments of the disclosure provide a computer readable storagemedium, the computer readable storage medium recording an executablecomputer program, the executable computer program being loaded by asmart device to perform steps of: enabling a touch capturing function onthe smart device, wherein the touch capturing function intercepts atouch event inputted to the smart device; in response to determiningthat a raw touch event is intercepted by the smart device, translatingthe raw touch event to a first touch event and sending the first touchevent to a host, wherein a display screen of the smart device ismirrored to a visual content shown by the host, and the first touchevent triggers the host to report a second touch event happened in thevisual content; disabling the touch capturing function and receiving thesecond touch event from the host; and performing a first operation inresponse to the second touch event and enabling the touch capturingfunction on the smart device.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings are included to provide a furtherunderstanding of the invention, and are incorporated in and constitute apart of this specification. The drawings illustrate embodiments of theinvention and, together with the description, serve to explain theprinciples of the disclosure.

FIG. 1 shows a schematic diagram of a mirror mode.

FIG. 2 shows a schematic diagram of using the smart device to replacethe handheld controller in FIG. 1 according to an embodiment of thedisclosure.

FIG. 3 shows a flow chart of the method for operating a mirrored contentunder a mirror mode according to an embodiment of the disclosure.

FIG. 4 shows a schematic diagram of enabling the touch capturingfunction according to an embodiment of the disclosure.

FIG. 5 shows the controlling regions on the cover layer according to anembodiment of the disclosure.

DESCRIPTION OF THE EMBODIMENTS

Reference will now be made in detail to the present preferredembodiments of the invention, examples of which are illustrated in theaccompanying drawings. Wherever possible, the same reference numbers areused in the drawings and the description to refer to the same or likeparts.

See FIG. 2 , which shows a schematic diagram of using the smart deviceto replace the handheld controller in FIG. 1 according to an embodimentof the disclosure. In FIG. 2 , the smart device 110 can be used toreplace the handheld controller 130 in FIG. 1 . That is, the user 199can hold the smart device 110 in hand and use the smart device 110 inthe way of using the handheld controller 130.

Specifically, the visual content 121 shown by the host 120 may include acontroller representative object 210 corresponding to the smart device110, and the host 120 may move the controller representative object 210in response to the movement of the smart device 110.

In one embodiment, the smart device 110 may collect the motion datathereof via a motion detection circuit (e.g., inertia measurement unit(IMU)) and provide the collected motion data to the host 120. In thiscase, the host 120 can determine the movement of the controllerrepresentative object 210 in the visual content 121 based on the motiondata from the smart device 110. Therefore, when the user 199 moves thesmart device 110 in the real world, the controller representative object210 would be correspondingly moved in the virtual world presented by thevisual content 121.

Similar to the scenario in FIG. 1 , the controller representative object210 can be designed with a raycast 210 a for the user 199 to point toany desired position in the visual content 121. In FIG. 2 , the user 199may use the raycast 210 a to trigger a desired application/function onthe smart device 110 via interacting with the specific region 122 withthe controller representative object 210 and/or the raycast 210 a.

However, since the smart device 110 has its own user interface 110 a,the user may accidentally activate undesired function/application on thesmart device 110 while interacting with the specific region 122 underthe mirror mode.

For example, if the user 199 wants to trigger the application 113 on thesmart device 110 while wearing the host 120 (i.e., the user 199 may notbe able to directly see the smart device 110), the user 199 may touchthe display screen 111 (which may be a touch screen) on a particularposition while using the raycast 210 a to point to the region 124corresponding to the application 113. However, since the user 199 maynot be able to directly see the smart device 110, if the particularposition where the user 199 touches on the display screen 111corresponds to the application 112, the smart device 110 might actuallyactivate the application 112 in response to the touch event inputted bythe user 199, rather than the desired application 113 of the user 199.

Since the display screen 111 is mirrored to the specific region 122 via,for example, streaming the screen frames of the smart device 110 to host120, the user 199 would see that the specific region 122 shows a resultof the smart device 110 launching the application 112, instead of theresult of launching the application 113 corresponding to the region 124pointed by the raycast 210 a.

Accordingly, the embodiments of the disclosure provide a solution forsolving the above technical problem, which would be introduced in thefollowing.

See FIG. 3 , which shows a flow chart of the method for operating amirrored content under a mirror mode according to an embodiment of thedisclosure. The method of this embodiment may be executed by the smartdevice 110 and the host 120 in FIG. 2 , and the details of each step inFIG. 3 will be described below with the components shown in FIG. 2 .

In step S321, the host 120 shows the visual content 121, wherein thevisual content 121 can be the content of the reality service (e.g., theVR service) provided by the host 120. In the embodiment, the smartdevice 110 and the host 120 are assumed to be operating under the mirrormode. That is, the display screen 111 of the smart device 110 ismirrored to the specific region 122 of the visual content 121. In otherembodiments, the aspect (e.g., the size and position) of the specificregion 122 can be arbitrarily designed based on the designer’srequirements.

In step S311, the smart device 110 may enable a touch capturing functionon the smart device 110, wherein the touch capturing function interceptsany touch event inputted to the smart device 110.

See FIG. 4 , which shows a schematic diagram of enabling the touchcapturing function according to an embodiment of the disclosure. In FIG.4 , the smart device 110 may enable the touch capturing function viaoverlaying the user interface 110 a of the smart device 110 with a coverlayer 410.

In this embodiment, the cover layer 410 may be transparent, and thesize/shape/position thereof may be arbitrarily designed based on thedesigner’s requirements. In one embodiment, the size of the cover layer410 may be designed to cover all of the user interface 110 a, but thedisclosure is not limited thereto.

In one embodiment, during the touch capturing function is enabled, anytouch event happened on the user interface 110 a would be interceptedand would not be used to directly control the smart device 110. Forexample, if the user 199 performs a touch operation on a first touchcoordinate on the cover layer 410 (i.e., the user 199 touches the coverlayer 410 on the position corresponding to the first touch coordinate),the smart device 110 would not directly operate based on the first touchcoordinate. Specifically, assuming that the first touch coordinatelocates on the application 112 of the user interface 110 a, the smartdevice 110 would not launch the application 112 in response to the touchoperation. In brief, the user 199 would not be allowed to directlyoperate the smart device 110 via touching the smart device 110.

Instead of directly performing operation in response to the touchoperation, the smart device 110 performs steps S312. In step S312, inresponse to determining that the a raw touch event (corresponding to thetouch operation) is intercepted by the smart device 110, the smartdevice 110 translates the raw touch event to a first touch event E1 andsends the first touch event E1 to the host 120.

In one embodiment, the intercepted raw event may be the touch event ofthe smart device 110. Since the raw touch event has been intercepted,the smart device 110 will not perform the operation originallycorresponding to the raw event for avoiding some problems such asactivating undesired application of the user 199. For example, assumingthat the raw touch event happens on the application 112 but the user 199actually wants to launch another function or application, the smartdevice 110 would not launch the application 112 in response to the rawtouch event.

Instead, the smart device 110 translates the raw touch event to thefirst touch event E1 and sends the first touch event E1 to the host 120.In one embodiment, the cover layer 410 can be disposed with severalcontrolling regions corresponding to different functions, and the smartdevice 110 may determine which of the controlling regions corresponds tothe raw event and determine the first touch event E1 according to thecorresponding function. For example, if the raw touch event correspondsto the controlling region for a function of confirming, the smart device110 may determine the first touch event E1 to be a touch event forconfirming. For another example, if the raw touch event corresponds tothe controlling region for a function of triggering, the smart device110 may determine the first touch event E1 to be a touch event fortriggering. For yet another example, if the raw touch event correspondsto the controlling region for a function of activating the system menu,the smart device 110 may determine the first touch event E1 to be atouch event for activating the system menu, but the disclosure is notlimited thereto.

In step S322, in response to receiving the first touch event E1 from thesmart device 110, the host 120 obtains a specific position indicated bythe controller representative object 210. In FIG. 2 , the specificposition indicated by the controller representative object 210 may bethe position pointed by the raycast 210 a in the visual content 121, butthe disclosure is not limited thereto.

In step S323, in response to determining that the specific position iswithin the specific region 122 (i.e., the region mirrored from thedisplay screen 111), the host 120 accordingly generates a second touchevent E2, wherein the second touch event E2 corresponds to a touchcoordinate of the specific position relative to the specific region 122.

In one embodiment, the display screen 111 may be designed with an origin(e.g., the top-left corner of the display screen 111), and the host 120can accordingly determine an origin within the specific region 122(e.g., the top-left corner of the specific region 122). In this case,the host 120 may characterize the specific position as a coordinaterelative to the origin of the specific region 122 and use thiscoordinate as the touch coordinate corresponding to the second touchevent E2, but the disclosure is not limited thereto.

In one embodiment, the second touch event E2 may include the touchcoordinate of the specific position pointed by the raycast 210 a and/orthe click event corresponding to the touch operation. In one embodiment,in response to determining that the click event corresponds to adragging operation inputted by the user 199 on the smart device 110, thesecond touch event E2 may, for example, indicate that the user 199 isperforming the dragging operation and the touch coordinate of thespecific position, such that the smart device 110 can be controlled to,for example, scrolling pages according to the second touch event E2, butthe disclosure is not limited thereto.

In the scenario of FIG. 2 , since the specific position pointed by theraycast 210 a is assumed to be within the region 124, the second touchevent E2 generated by the host 120 may be used to simulate the situationof the user 199 touches a corresponding touch coordinate on the displayscreen 111, which may be a touch coordinate corresponding to theapplication 113.

In step S324, the host 120 sends the second touch event E2 to the smartdevice 110, wherein the second touch event E2 triggers the smart device110 to perform a first operation in response to the second touch eventE2. However, if the touch capturing function (e.g., the cover layer 410)is still enabled while receiving the second touch event E2, the secondtouch event E2 would also be intercepted, such that the smart device 110would not be able to perform the first operation in response to thesecond touch event E2. More specifically, if the touch capturingfunction is still enabled when the host 120 transmits the second touchevent E2 to the smart device 110, the smart device 110 may treat thesecond touch event E2 in the way of treating the raw touch event. Inthis case, the smart device 110 may translate the second touch event E2to another touch event and send it to the host 120 without performingthe first operation corresponding to the real operating intention of theuser 199.

Therefore, after the smart device 110 performs step S312, the smartdevice 110 can subsequently perform step S313 to disable the touchcapturing function (e.g., removing the cover layer 410) and perform stepS314 to receive the second touch event E2 from the host 120.Accordingly, the second touch event E2 would not be intercepted by thetouch capturing function and can be used to actually control the smartdevice 110.

In step S315, the smart device 110 performs the first operation inresponse to the second touch event E2. In one embodiment, in response todetermining that the touch coordinate corresponds to a specificapplication or a specific function in the user interface 110 a of thesmart device 110, the smart device 110 can activate the specificapplication or the specific function as performing the first operation.

For example, the smart device 110 can launch the application 113corresponding to the specific position indicated by the controllerrepresentative object 210. Since the display screen 111 is mirrored tothe specific region 122, the user 199 would see that the specific region122 shows a result of the smart device 110 launching the application113. That is, the embodiments of the disclosure provide a solution forthe user to use the smart device 110 as a handheld controller under themirror mode.

In some embodiments, the cover layer 410 can be designed with one ormore controlling regions for the user 199 to activate particular systemfunctions of the reality service provided by the host 120.

In one embodiment, in response to determining that the first touch eventE1 happens on a first touch coordinate on the cover layer 410, the smartdevice 110 may obtain a first controlling region of the controllingregion where the first touch coordinate locates and notify the host 120to activate a first system function corresponding to the firstcontrolling region.

See FIG. 5 , which shows the controlling regions on the cover layeraccording to an embodiment of the disclosure. In FIG. 5 , the coverlayer 410 may include controlling regions 511-514. In the embodiments ofthe disclosure, since the user 199 may not be able to see thecontrolling regions 511-514 due to wearing the host 120, the sizes ofthe controlling regions 511-514 may be designed to be large enough forfacilitating the user to touch, but the disclosure is not limitedthereto.

In one embodiment, the controlling region 511 may be used as theconfirming button disposed on the handheld controller 130 in FIG. 1 . Inthis case, the user 199 may touch the controlling region 511 while usingthe raycast 210 a to point to the region 124 to trigger the smart device110 to launch the application 113, but the disclosure is not limitedthereto. In addition, the controlling region 512 may be designed withthe same function as the controlling region 511, but the disclosure isnot limited thereto. In one embodiment, the first touch event E1translated from the corresponding raw touch event when the user 199touches the controlling region 511 or 512 may be determined by the smartdevice 110 to be a touch event for confirming, as mentioned in theabove.

In one embodiment, the controlling region 513 may correspond to thesystem function of showing a system menu. In this case, when the user199 touches the controlling region 513, the smart device 110 maydetermine that the coordinate where the user 199 touches on the coverlayer 140 corresponds to the controlling region 513, and the smartdevice 110 may notify the host 120 to show the system menu of thereality service provided by the host 120, but the disclosure is notlimited thereto. In one embodiment, the first touch event E1 translatedfrom the corresponding raw touch event when the user 199 touches thecontrolling region 513 may be determined by the smart device 110 to be atouch event for activating the system menu, as mentioned in the above.

In one embodiment, the controlling region 514 may correspond to thesystem function of showing recently opened applications. In this case,when the user 199 touches the controlling region 514, the smart device110 may determine that the coordinate where the user touches on thecover layer 140 corresponds to the controlling region 514, and the smartdevice 110 may notify the host 120 to show the recently openedapplication on the host 120, but the disclosure is not limited thereto.In one embodiment, the first touch event E1 translated from thecorresponding raw touch event when the user 199 touches the controllingregion 514 may be determined by the smart device 110 to be a touch eventfor showing the recently opened applications.

In some embodiments, the controlling regions 511-514 on the cover layer140 may be invisible/transparent. In this case, although the cover layer410 is overlaid on the user interface 110 a, people near the smartdevice 110 can only see the user interface 110 a, but not thecontrolling regions 511-514, but the disclosure is not limited thereto.

In one embodiment, the controller representative object 210 may bedesigned to have the appearance similar to the layout of the controllingregions 511-514. In one embodiment, the controller representative object210 may be an interface for the user’s reference, so that user 199 knowswhich region on the controller representative object 210 corresponds towhich of the controlling regions 511-514 on the smart device 110 andknows where to touch to use the smart device 110 in a way of using thehandheld controller.

Referring back to FIG. 3 , the smart device 110 perform S316 to enablingthe touch capturing function on the smart device 110. From anotherperspective, the smart device 110 can be understood as returning to stepS311 after step S315, such that the touch capturing function canintercept subsequent touch event happened on the smart device 110. Inthis case, the smart device 110 can wait and intercept the next touchevent. In response to intercepting the next touch event, the smartdevice 110 can regard this touch event as the first touch event E1 andaccordingly perform steps S312-S316, and the host 120 can perform thecorresponding steps S322-S324. Details can be referred to the abovedescriptions.

In the embodiments of the disclosure, the time length for performingsteps S313 to S316 could be very short, such that the user 199 may notnotice that the touch capturing function has been disabled and enabled.Accordingly, the operations of the user 199 on the smart device 110would not be affected.

The disclosure further provides a computer readable storage medium forexecuting the method for operating a mirrored content under a mirrormode. The computer readable storage medium is composed of a plurality ofprogram instructions (for example, a setting program instruction and adeployment program instruction) embodied therein. These programinstructions can be loaded into the smart device 110 and/or the host 120and executed by the same to execute the method for operating a mirroredcontent under a mirror mode and the functions of the smart device 110and/or the host 120 described above.

In summary, the embodiments of the disclosure can enable the touchcapturing function for intercepting the first touch event when the smartdevice and the host are operating under the mirror mode, such that thesmart device would not directly perform the corresponding operation inresponse to the first touch event. In addition, the host can obtain thespecific position indicated by the controller representative object inresponse to the first touch event intercepted by the smart device andaccordingly provide the second touch event to the smart device, whereinthe second touch event can simulate the situation of the user touches acorresponding touch coordinate on the display screen of the smartdevice. In this case, the smart device can perform the first operationin response to the second touch event that actually reflecting thebehavior of the user. Accordingly, the embodiments of the disclosureprovide a solution for the user to use the smart device as a handheldcontroller under the mirror mode.

It will be apparent to those skilled in the art that variousmodifications and variations can be made to the structure of the presentinvention without departing from the scope or spirit of the disclosure.In view of the foregoing, it is intended that the present disclosurecover modifications and variations of this invention provided they fallwithin the scope of the following claims and their equivalents.

What is claimed is:
 1. A method for operating a mirrored content under amirror mode, comprising: enabling, by a smart device, a touch capturingfunction on the smart device, wherein the touch capturing functionintercepts a touch event inputted to the smart device; in response todetermining that a raw touch event is intercepted by the smart device,translating, by the smart device, the raw touch event to a first touchevent and sending, by the smart device, the first touch event to a host,wherein a display screen of the smart device is mirrored to a visualcontent shown by the host, and the first touch event triggers the hostto report a second touch event happened in the visual content;disabling, by the smart device, the touch capturing function andreceiving, by the smart device, the second touch event from the host;and performing, by the smart device, a first operation in response tothe second touch event and enabling, by the smart device, the touchcapturing function on the smart device.
 2. The method according to claim1, wherein the display screen of the smart device is mirrored to aspecific region of the visual content, the visual content comprises acontroller representative object corresponding to the smart device, andthe method further comprises: in response to receiving the first touchevent from the smart device, obtaining, by the host, a specific positionindicated by the controller representative object; in response todetermining that the specific position is within the specific region,accordingly generating, by the host, the second touch event, wherein thesecond touch event corresponds to a touch coordinate of the specificposition relative to the specific region.
 3. The method according toclaim 2, wherein the controller representative object has a raycastemitted from the controller representative object, and the specificposition is a position pointed by the raycast in the visual content. 4.The method according to claim 1, wherein the visual content comprises acontroller representative object corresponding to the smart device, andthe method further comprises: obtaining, by the smart device, a motiondata of the smart device; providing, by the smart device, the motiondata to the host, wherein the motion data triggers the host to move thecontroller representative object in the visual content in response tothe motion data.
 5. The method according to claim 1, wherein the step ofenabling the touch capturing function on the smart device comprises:overlaying, by the smart device, a user interface of the smart devicewith a cover layer.
 6. The method according to claim 5, wherein thecover layer is transparent.
 7. The method according to claim 5, whereinthe cover layer comprises at least one controlling region, wherein eachcontrolling region is used to activate a system function of a realityservice provided by the host.
 8. The method according to claim 7,wherein the first touch event happens on a first touch coordinate on thecover layer, and the method further comprises: obtaining, by the smartdevice, a first controlling region of the at least one controllingregion where the first touch coordinate locates; notifying, by the smartdevice, the host to activate a first system function corresponding tothe first controlling region.
 9. The method according to claim 1,wherein the first touch event happens on a first touch coordinate on thecover layer, and the method further comprises: in response todetermining that the first coordinate locates on a first applicationshown in the user interface, not launching the first application. 10.The method according to claim 1, wherein the second touch eventcomprises a touch coordinate, and the step of performing the firstoperation in response to the second touch event comprises: in responseto determining that the touch coordinate corresponds to a specificapplication or a specific function in a user interface of the smartdevice, activating, by the smart device, the specific application or thespecific function.
 11. A method for operating a mirrored content under amirror mode, comprising: showing, by a host, a visual content, wherein aspecific region of the visual content is mirrored from a display screenon a smart device, and the visual content comprises a controllerrepresentative object corresponding to the smart device; in response toreceiving a first touch event from the smart device, obtaining, by thehost, a specific position indicated by the controller representativeobject; in response to determining that the specific position is withinthe specific region, accordingly generating, by the host, a second touchevent; sending, by the host, the second touch event to the smart device,wherein the second touch event triggers the smart device to perform afirst operation in response to the second touch event.
 12. The methodaccording to claim 11, wherein the controller representative object hasa raycast emitted from the controller representative object, and thespecific position is a position pointed by the raycast in the visualcontent.
 13. The method according to claim 11, further comprising:receiving, by the host, a motion data of the smart device from the smartdevice; moving, by the host, the controller representative object in thevisual content in response to the motion data.
 14. The method accordingto claim 11, wherein the first touch event happens on a first touchcoordinate of the smart device, and the method further comprises:receiving, by the host, a notification from the smart device; activatinga first system function in response to the notification, wherein thefirst system function corresponds to a first controlling region wherethe first touch coordinate locates on the smart device.
 15. Anon-transitory computer readable storage medium, the computer readablestorage medium recording an executable computer program, the executablecomputer program being loaded by a smart device to perform steps of:enabling a touch capturing function on the smart device, wherein thetouch capturing function intercepts a touch event inputted to the smartdevice; in response to determining that a raw touch event is interceptedby the smart device, translating the raw touch event to a first touchevent and sending the first touch event to a host, wherein a displayscreen of the smart device is mirrored to a visual content shown by thehost, and the first touch event triggers the host to report a secondtouch event happened in the visual content; disabling the touchcapturing function and receiving the second touch event from the host;and performing a first operation in response to the second touch eventand enabling the touch capturing function on the smart device.